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Abstract. The learning of rules from examples is of continuing interest 
to machine learning since it allows generalization from fewer training ex- 
amples. Inductive Logic Programming (ILP) generates hypothetical rules 
(clauses) from a knowledge base augmented with (positive and negative) 
examples. A successful hypothesis entails all positive examples and does 
not entail any negative example. The Shared Neural Multi-Space (Shared 
NeMuS) structure encodes first order expressions in a graph suitable for 
ILP-style learning. This paper explores the NeMuS structure and its re- 
lationship with the Herbrand Base of a knowledge-base to generate hy- 
potheses inductively. It is demonstrated that inductive learning driven 
by the knowledge-base structure can be implementated successfully in 
the Amao cognitive agent framework, including the learning of recursive 
hypotheses. 


1 Introduction 


There is renewed interest in inductive logic programming as a framework for 
machine learning owing to its human like ability to infer new knowledge from 
background knowledge together with a small number of examples. It also comes 
with strong mathematical and logical underpinnings. This paper builds on [9], 
where a data structure (Shared NeMuS) for the representation of first-order logic 
was introduced. It revisits inductive logic programming and demonstrates that 
Shared NeMuS provides a structure that can be used to build an inductive logic 
programming system. 

A part of the Shared NeMuS structure is weightings on individual elements 
(atom, predicate, function). The purpose of these weightings is to provide a guide 
to the use of these elements, for example in theorem proving. One of the key 
challenges in inductive logic programming is to find good heuristics to search 
the hypothesis space; the long-term goal of this work is to learn weights in a 
training phase that can in turn be used to guide the search of the hypothesis 
space and improve the efficiency and success of inductive learning. 

The main purpose of this work is to present a new approach for Clausal 
Inductive Learning (CIL) using Shared NeMuS in which the search mechanism 


uses the Herbrand Base (HB) to build up hypothesis candidates using inverse 
unification. This generalization of ground expressions to universally quantified 
ones is supported by the idea of regions of concepts that was explored in [9] to find 
refutation patterns. Here, weights are not explicitly used, but the intuitive use of 
them is explored to define linkage patterns between predicates of the HB and the 
occurrences of ground terms in positive examples. Meaningless hypotheses are 
pruned away as a result of inductive momentum between predicates connected to 
positive and negative examples. This paper makes the following contributions: it 
is demonstrated that the Shared NeMuS data structure can be used as a suitable 
structure for inductive logic programming; the Herbrand Base is used to build 
candidate hypotheses; chaining and abstraction for rules, including recursive 
rules, are given; these rules help keep the number of hypotheses small. NeMuS 
is designed for extension with machine learning tactics. 

The remainder of this paper is structured as follows: section 2 gives some 
brief background on inductive logic programming and the Shared NeMuS data 
structure, sections 3 and 4 describe the implementation of inductive learning in 
Amao using the Shared NeMuS data structure, then section 5 describes some 
related work and section 6 discusses the work presented. 


2 Background 


2.1 Inductive Logic Programming (ILP) 


The goal of inductive logic programming (introduced in [10]) is to learn logical 
formulae that describe a target concept, based on a set of examples. In a typical 
set up there is a knowledge base of predicates, called background knowledge 
(BK), along with a set of examples that the target concept should prove (positive 
examples, e+) and a set of examples that the target concept should not prove 
(negative examples, e~). The inductive logic programming problem is to search 
for a logical description (a hypothesis, H) of the target concept based on the 
knowledge and the examples so that the knowledge base plus the hypothesis 
entails the positive examples, whilst does not entail the negative examples. 

Inductive logic programming systems implement search strategies over the 
space of possible hypotheses. A good heuristic is one that will a) arrive at a suc- 
cessful hypothesis, b) find this hypothesis quickly and c) find a succinct hypoth- 
esis. In order to achieve this, the efficiency of hypothesis searching mechanisms 
depend on partial order of @-subsumption [13], or on a total ordering over the 
Herbrand Base to constrain deductive, abductive and inductive operations [12]. 

The approach presented in this paper for CIL takes a totally different ap- 
proach. Search considers separated spaces for constant terms, predicates and 
clauses, and elements are indexed by their unique identification codes. The spaces 
are interconnected through weighted bindings pointing to the target space in 
which an occurrence of an element appears. This creates a network of shared 
spaces because the elements are shared via bindings. As the weights are not 
used here, the networks shall be referred to as multi-spaces. 


2.2 Shared NeMuS 


Shared Neural Multi-Space (Shared NeMuS) [9] takes inspiration from [2] to give 
a shared multi-space representation for a portion of first-order logic designed for 
use with machine learning and neural network methods. The structure incorpo- 
rates a relative degree of importance for each element according to the element’s 
attributes and uses an architecture that leads to a fast implementation. 

Shared NeMuS uses a Smarandache multi-space [8], a union of n spaces 
Aj,...,; An in which each A; is the space of a distinct observed characteristic of 
the overall space. For each A; there is a different metric to describe a different 
side of the ”major” side. There will be a space for each component of a first-order 
language: atomic constants (of the Herbrand Universe, space 0), functions (space 
1), predicates with literal instances (space 2), and clauses (space 3). Variables 
are used to refer to sets of atomic terms via quantification, and they belong to 
the same space of atoms. In this work, the function space is suppressed, since it 
is not being dealt with for relational learning. In what follows vectors are written 
v, and v{i] or v; is used to refer to an element of a vector at position i. 

Each logical element is described by a T-Node, and in particular each element 
is described by a unique integer code within its space. In addition, a T-Node 
identifies the lexicographic occurrence of the element, and (when appropriate) 
an attribute position. 


Definition 1 (T-Node and Binding) Let c,a,i € Z and h © {0,1,2,3}. A 
T-Node (target node) is a quadruple (h,c,i,a) that identifies an object at space 
h, with code c and occurrence 1, at attribute position a (when it applies, otherwise 
1). If p is a T-Node, then np(p) = h, ne(p) = c, na(p) = a and ni(p) =i. A 
NeMuS Binding is a pair (p,w),, which represents the influence w of object k 
over occurrence ni(p) of object ne(p) at space np (p) in position na(p). 


The elements of the subject space represent all of the occurrences of atoms 
and variables in an expression. 


Definition 2 (Subject Space) Let C = [a1,...,a%m] and V = [y,,..-,Ynl; 
where each xj, y, is a vector of bindings. Subject Space refers to the pair (C,V) 
for constants and variables, respectively. 


The function 6 maps a constant 7 to the vector of its bindings a;, as above. 

Higher spaces are made of structured elements, such as predicates and clauses. 
Such objects have attributes uniquely identified by T-Nodes referring to objects 
in the spaces below and their bindings of the objects on which they exert influ- 
ence. 


Definition 3 (Compound) Let x’, = [c1,...,¢m] be a vector of T-Nodes for 
each attribute instance of compound 1. Let w; be a vector of NeMuS bindings. 
Then a NeMuS Compound is the pair (x',,w;). 4 NeMuS Compound Space 
(C-Space) ts a vector of NeMuS Compounds. 


For each literal there is a C-Space to represent it. Since a literal is an instance 
of a predicate the predicate space is a vector of C-Spaces. As predicates have 
positive and negative instances, there are two vector regions for a predicate 
space. Clauses’ attributes are the literals that they are made of, and as they 
exert no influence upon spaces above for simplicity the bindings of a clause shall 
be empty. 


Definition 4 (Predicate and Clause Spaces) Let en and C,, be two vec- 
tors of C-spaces. The pair (Cx, C;,) is called the NeMuS Predicate Space. A 


NeMuS Clause Space is a vector of C-spaces such that every pair in the vector 
shall be (2%,, []). 


a? 


A Shared NeMuS for a coded first-order expression is a triple (S,P,C), in 
which S is the subject space, P is the predicate space and C is the clause space. 


Example 1. Assume the following symbolic BK (adapted from [3]): 


mother (pam, ann) . 
wife(ann, bob). 
wife(eve,wallie). 
brother(wallie, ann). 


This translates into the Shared NeMuS below (with weights at default value of 
0). The constant region of the subject space, the predicate space and the clause 
space are each given with some commentary. The labels and the numbers before 
the column are just to emphasise structure. 


Subject Space: Constant region: { 
eLCOst 1) <0) 
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The subject space encodes the occurrences of the constants. For example, the 
first entry gives the binding for pam, with code 1, stating that this atom occurs 
in the first occurrence of the first predicate (mother) as the first attribute. The 
second entry gives the list of bindings for the three occurrences of ann. 


Predicate Space: 


// pam ann 
{+1:00000,1,1,1),(00,2,1,2)],[0(3,1,1,1),0)])], -1: [1} 
// ann bob 


{+2:((((0,2,2,1),(0,3,1,2)],(0(3,2,1,1),0)]), 
COCO 45252) 910, 55452) 1. bCC8 53154) 0)T) 1. 2s kt 
{+3:(¢100,5,2,1),(0,2,3,2)],[¢0(3,4,1,1),0)])], -3: OF} 


The predicate space encodes each predicate. For example, the first entry links to 
the bindings of the two constants occurring in the only clause in which it occurs. 
The second entry details the two clauses for wife. 


Clause Space: 
WO Aedes LOLs COO? sles T's 
C0 2535 2) 4 CEOs 3. 21D TOF 


Here, the clauses link back to the predicates that define them. For example, the 
first entry says that the first clause is built from the first predicate. 

This simple example shows how easy it is to navigate across a shared NeMuS 
structure to induce new rules from relational data or sets of literals. 


3 Inductive Learning with Shared NeMuS 


This section describes, with the aid of running examples, how inductive learning 
is performed in Amao, using the Shared NeMuS structure. Amao® a cognitive 
artificial agent which originally performed just symbolic reasoning on structured 
clauses via Linear Resolution [16]. It was extended in [9] to generate a shared 
NeMuS representation, during the compilation of symbolic representation, for 
neural-symbolic reasoning purposes. 

Inverse unification from HB is plausible since all ground expressions of a given 
concept p will be at the same region as far as weighted grounds are concerned. 
For instance, p(a, b), p(c, d) and p(b, e) all belong to the region of p. So, p(X, Y) is 
a sound generalization of such instances. However, if there are other concepts in- 
volving the elements of the Herbrand Universe, say g(a, d) and r(d) then p(X, Y) 
is not a straight generalization without taking into account the combination of 
the regions for r and q since their ground atoms have occurrences of constants 
appearing in all three concepts. 

The induction algorithm proposed is guided by kinds of linkage patterns (sec- 
tions 3.1 and 3.2) and using only those in which there is an inductive momentum 
(section 3.3). The explanation is that positive examples bring the ground expres- 
sions ” close” to the hypothesis to be generated, while the negative ones pull apart 
those which are likely to generate inconsistent hypothesis. 


3.1 Linear Linkage Patterns 


One form of the Amao operation for performing inductive learning with target 
predicate p/n is: 


consider induction on p(X1,...,Xn) knowing p(t1,...,tn). 


That is, p/n is not in the Bk and Amao will attempt to find a hypothesis H 
such that the positive example(s) p(t1,...,tn) can be deduced from BK U H. 
In what follows, the symbol representation will be used to mean the Shared 
NeMuS code of each logical element and recall that 6 maps code symbols to 
their bindings. 


3 Amao is the name of a deity that taught people of Camanaos tribe, who lived on 
the margins of the Negro River in the Brazilian part of the Amazon rainforest, the 
process of making mandioca powder and beiju biscuit for their diet. 


The BK is that used in Example 1. Suppose that the target predicate is 
motherInLaw/2, with positive knowledge motherInLaw(pam,bob) then when 
Amao is asked to generate hypotheses with 


consider induction on motherInLaw(X,Y) knowing motherInLaw(pam, bob). 
amongst the successful hypotheses should be: 
motherInLaw(X,Y) <— mother(X, Z) A wife(Z,Y) 


Parsing the positive example against the Shared NeMuS representation of 
the BK gives that in the constant region pam has code 1 and bob has code 3. 
From the constant region of the subject space the vectors of bindings 6(1) and 
G(3) are found: 


1)]: in the first predicate, its first instance, as first attribute 
,2)]: in the second predicate, its first instance, as second attribute 


For each element of the vector of bindings, 6(i), the vector of attributes of 
the predicate in which it occurs is found, written x_(6(i);), where 7 is an index. 
Here, 


La(B(1)1) = [(0, 1,1, 1); (0, 2,1, 2)] and La(B(3)1) ma [(0, 2,2, 1); (0, 3,1, 2)] 


that is, mother(pam, ann) and wife(ann, bob). 

The intersection between r_(G(pam),) and x_(6(bob);) is non-empty since 
ann (code 2) occurs in both. Hence predicate codes 1 (mother) and 2 (wife) are 
used in the hypothesis. These are ground atoms from the HB of Example 1, and 
from them a new clause is built with head (positive) literal as the target anti- 
unified, and the negative literals are those found above. Inverse unification will 
incrementally build anti-substitution 6~' at each step by adding literals to the 
body with constants substituted by variables X and Y from the targeted head. As 
X appears as the first attribute of the first predicate (mother), and Y as the second 
attribute of the second predicate (wife), then the linkage term shall be Z_0. Call 
Z_0 the hook between both literals and the final 0~' is {pam/X,bob/Y,ann/Z_O}. 
The terms which are not the hook term are called attribute-mates. Thus the 
hypothesis is the following clause in Amao notation: 

motherInLaw(X,Y); ~mother(X,Z_0); ~wife(Z_0,Y) 

This rule is added to the KB and its Shared NeMuS is updated accordingly. 

In general this hook chain can be longer and involve more linkage predicates. 
Depending on the position where the linkage is formed from one to another there 
may be different sorts of linkage pattern. Besides, there can be intermediate 
predicates that should not be part of the hypothesis since they may deduce 
negative examples. Consider the following example, and this time for the sake of 
readability the space information will be suppressed from the bindings and the 
attribute position from 2. 


Example 2. Consider the following BK. 


1. parent (pam, bob). 6. parent (pat, jim). 1. female (pam). 
2. parent (tom, bob). 7. parent (ann,eve). 2. female(liz). 
3. parent (tom,liz). 1. male(tom). 3. female(ann). 
4. parent (bob, ann). 2.male(bob). 4. female(pat). 
5. parent (bob, pat). 3. male(jim). 5. female (eve). 


Codes for the logical elements in the order they are read or scanned are: 


parent|male|female||pam|bob|tomlliz|ann|pat |jim|eve 
172] 3 P1272] 3 ]4f5]e]7]s 


The induction Amao is requested to perform is 


consider induction on hasDaughter (X) 
knowing hasDaughter(ann) ~hasDaughter (pat) . 


First find the bindings associated with the positive and negative examples. 
+(ann) = [(1,4,2), (1,7,1), (3,3, DJ and — 6(pat) = [(1,5,2), (1,6, 1), (3,4, D] 


n-(B(ann),) = n-(G(pat);) = 1 and their positions are the same in the 
predicate attributes, given by na(S(ann)1) = na(G(pat)1) = 2. As both appear 
along with the same constant bob (2). 


La(B(ann)1) = [(0, 2, 3), (0, 5, 1)| and La(B(pat)1) 7 [(0, 2, 4), (0, 6, 1)] 


This path will give hypotheses which make hasDaughter (pat) deducible, which 
is not desirable since hasDaughter(pat)€ e~. Call this an inconsistent path, 
and the instance is dropped and another selected. 

ne(B(ann)2) = ne(B(pat)2) = 1 and na(B(ann)2) = na(G(pat)2) = 1. This 
time their attribute-mates are different, eve (8) for ann and jim (7) for pat 


ta(B(ann)2) = [(0, 5,2), (0,8, 1)] and wa(6(pat)2) = [(0,6, 2), (0,7, 1)]. 


This splits the path into two branches and it cannot be said, at this stage, if 
both will lead to atomic sentences belonging to the Herbrand Base, thus de- 
ducible. Call this a plausible path. From this point the first literal for the body 
of the hypothesis can be considered as a generalization of parent(ann, eve), 
i.e. parent(X, Zo) (where {ann/X, eve/Zo} is the inverse or anti-unification of 
terms) has to be confirmed by pruning away any possible predicate found in the 
bindings of j2m onwards. 


+6(eve) = [(1, 7,2), (3,5,1)] and — 8(jim) = [(1,6, 2), (2,3, 1)] 


Their first bindings fail in the same inconsistent path as in the case of ann 
and pat, and so they must be dropped. However, their occurrences happen at 
different predicates as shown by 


ne(B(eve)2) = 3 (for female) n,-(G(jim)2) = 2 (for male) 


This means that the path has reached a state of positive path only, meaning 
that predicate 2 (male) can be dropped and female(eve) ends the search for 
this branch. Add to the body the general formula female(Z). The search for a 
hypothesis might stop here and Amao would learn 


hasDaughter(X) < parent(X, Zo) A female(Zo) 


This hypothesis meets the desired definition. If search is continued, further hy- 
potheses might be found such as 


hasDaughter(X) < parent(X, Zo) A female(Zo) A female(X) 


which is also consistent with BK, e+ and e~. 


Algorithm 1 LinkagePattern(p,, py are T-Nodes ) 


1: if ne(pe) = ne(pe1) then > possible recursive pattern 
2: if ta(pr) N Xa(pei) # @ then 
3: if na(pr) < Na(pei) then > (position of ay is less than position of ax) 
4: return linear_and_recursive 
5: else if na(px) = Na(pei) then 
6: return sink_hook 
7 else 
8 return side_hook_pattern 
9: else 
10: if na(pr) < na(pri) then > (position of ax is less than position of axz1) 
11: return linear_or_recursive 
12: else if na(px) = Na(pei) then 
13: return deep_sink_hook 
14: else 
15: return long_-side_hook 
16: else 
17: if va(pr)N Xa(pei) = @ then 
18: return unknown_hook 
19: else 
20: return short_linear_hook 


3.2 Recursive Linkage Pattern 


Suppose Amao is asked to generate hypotheses with ancestor(X,Y) with posi- 
tive background knowledge ancestor (pam, jim). 


consider induction on ancestor(X,Y) knowing ancestor(pam, jim). 


Although there is a long linear linkage from pam until jim, the successful expected 
hypotheses should be recursive having ~ parent(X,Y) as base. Amao generates 


these as learned hypotheses by following the same steps as for linear linkage, 
except that the first pair of p, and pz; from G(az,) and 8(az1) is checked for 
equality. In other words, if ne(pp) # Ne(ppi), then the linkage pattern is linear 
and proceed as above. Otherwise it is possible that there is a recursive pattern. 
Algorithm 1 diagnoses which linkage pattern to apply (including some not dis- 
cussed here as they are intended to be used within a neural network learning 
extension of the current method for large background knowledge). In Algorithm 1 
Na(pr) and ng(ppi) are the attribute positions for a, and az1, respectively. 


3.3. Inductive Momentum 


The definition of ILP and all implementations use negative examples e~ more 
as a testing case to check whether a generated hypothesis H plus BK will entail 
e_. If so, then the cause of the undesired deduction is detected, fixed and a new 
hypothesis generated. The approach in this work is different: negative example 
can be used to prune away candidates to generalized body literals if they have 
been reached from the bindings of terms from e~ (call them negative terms). 

The inductive momentum between two T-Nodes a* of wf and a~ of a7 
given partial 6~! is given by Algorithm 2. 


Algorithm 2 InductiveMomentum(a7 ,at az ,a7 ) 


1: if no attribute of ef has an anti-substitution in 9~! then 


2: return useless_path. 

3: if ne(at) =n-(a_) then 

A: if na(at) = na(a_) then 

5: if both attribute-mates at of af and a~ of 27 are equal then 
6: return inconsistent_path 

7: else 

8: return plausible_path 

9: else 

10: plausible_path 


11: return positive_path_only 


4 The Inductive Learning Algorithm 


The induction algorithm presented in Algorithm 3 works as a search guided 
by the linkage pattern (Algorithm 1) and inductive momentum (Algorithm 2). 
Algorithm 3 is given a shared NeMuS N, a target P with code p/n, and coded 
positive and negative examples et and e~ with their respective coded terms 
being ar (possibly i): a,, (possibly a;,) respectively. 

Note that step 8 guarantees that ground atoms common to the e+ and e7 
derivation chain are left out of the partial clause hypothesis building process. 


Algorithm 3 InductiveLearn(N pz, pei are T-Nodes ) 


1: Or + 0" (ax, Ax1) 

2: BY — Blat) (and Bf, < B(ajt,) if exists af,) from NV 

3: By + B(a,) (and 6,, < B(a;,,) if exists a,,) from NV 

4: while 6, 4 @ do 

5: Hyp & OrP 

6: select px (pE,) Py (Pyr) from BY (8f,) and By (8,1) 

7: if There exists a useful LinkagePattern(p7, p{,) then 

8 if InductiveMomentum(zxa(nc(p} )), na(pz)), Ta(Ne(p; )), Na(p, )) then 


9: if linkage is linear_and_recursive then 
10: 0, + O~*(xa(ne(p7))) U clone(Or) 
11: Hy < 0,(clone(Hp)U ~ pr) 
12: 0, + 0 *(aa(ne(pp,))) U Or 
13: H,. © 0,(clone(H,)U ~ pri) 
14: else 
15: 6, < 67" (clone(Or), ta(ne(pz ))) 
16: O2 + 8 *(01, a(Ne(DEy))) 
17: Hy < 02(clone(Hp)U ~ prU ~ prt) 
18: if Oo, = 02 then 
19: save hypotheses generated 
20: update 6s with bindings from attribute-mates(linkage terms). 


This avoids inconsistency by not allowing the generation of hypotheses that 
would satisfy e~ along with BK. 

Consider again the example with ancestor/2 to give an intuitive idea of 
how negative examples are used as an inductive momentum. Everything else is 
left out of the hypothesis since it will not be part of the HB that satisfies the 
positive examples e+ plus BK and hypothesis. The process builds the hypothesis 
by selecting from the intersection those that meet one of the linkage patterns, 
and are not eliminated as a result of an inductive momentum. 


>> consider induction on ancestor(X,Y) knowing ancestor (pam, jim). 
--> Consider using these hypotheses... 

ancestor(X,Y); ~parent(X,Y). 

ancestor(X,Y); ~parent(X,Z0); ~ancestor(Z0,Y). 


5 Related Work 


Inductive logic programming has a large literature, from its antecedents in induc- 
tive generalization [14], through work on search strategies, the logical framework 
that the learning sits in, as well as the building of systems and application of 
these to specific problems. Inductive learning continues to be of interest in a 
wide range of contexts and applications as recently surveyed in [5]. 

Of particular relevance is the work in [4] that investigates path based algo- 
rithms to generate relationships and [15] that uses inductive logic programming 
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concepts in an early instance of theory repair (that is, revising a theory that is 
incorrect so that the counter-examples are no longer such). Additionally [6], that 
investigates variations on the standard anti-unification algorithm and how these 
impact on the efficiency of hypothesis search, is of interest in the current con- 
text. More recently, in [1] boolean constraints are used to describe undesirable 
areas of the hypothesis search space and solving these to prune the search space 
achieves significant speed ups over older inductive logic programming systems 
on a range of examples, whilst retaining accuracy. 

The higher-order approach taken in [11,12] uses a meta-interpreter with it- 
erative deepening to build Metagol. Metagol has had success on a range of ex- 
amples, including learning a subclass of context-free grammars from examples 
and inferring relationships in sports data (whilst also uncovering an error in the 
data representation). This includes predicate invention, a topic that these papers 
suggest has not been paid due attention in inductive learning. 


6 Discussion and Future Work 


This paper has shown how the Amao Shared NeMuS data structure can be used 
to build an inductive logic programming system which has been successfully 
applied on some small trial examples. 

The results on inductive learning in Amao show that using its shared struc- 
ture leads to reliable hypothesis generation in the sense that the minimally cor- 
rect ones are generated. However, it still generates additional hypothesis, log- 
ically sound and correct with respect to the Herbrand base derivation. Most 
important is the size of the set of hypotheses generated which is small in com- 
parison with the literature, e.g. [3]. 

Future work will focus on two areas. First, the power of the shared structure 
to allow a fast implementation of inductive inference. Second, the weights incor- 
porated in the Shared NeMuS structure (not used in the current paper) will be 
used to play an important role in providing heuristics. In [9] it is shown how these 
weights can be updated in a manner inspired by self-organising maps [7]. The 
propagation across the network of nodes in the structure allows the weights to 
capture patterns of refutation. It should be possible to capture negative examples 
in inductive logic programming in the network in this way, guiding search away 
from these unfruitful regions to fine tune to a small set of generated hypotheses. 
Alongside improved hypothesis search the use of the weighted structure to drive 
predicate invention — to add to the knowledge base additional inferred predicates 
contained in neither it nor the target predicate — will be investigated. 
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